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Abstract 


Recently, a new kind of set, named as Random Permutation Set (RPS), is 
proposed. RPS takes the permutation of a certain set into consideration, 
which can be regarded as a generalization of evidence theory. Uncertainty 
is an important feature of RPS. A straightforward question is how to mea- 
sure the uncertainty of RPS. To address this problem, the entropy of RPS is 
presented in this paper. When the order of elements in permutation event 
is ignored, the proposed RPS entropy degenerates into Deng entropy in 
evidence theory. When each permutation event is limited to containing 
just one element, the proposed RPS entropy degenerates into Shannon en- 
tropy in probability theory. Hence the RPS entropy can be regarded as the 
generalization of Deng entropy and Shannon entropy. Numerical exam- 


ples are illustrated the efficiency of the proposed RPS entropy. 


“Corresponding author: Yong Deng, Institute of Fundamental and Frontier Sciences, 
University of Electronic Science and Technology of China, Chengdu, China. Email ad- 
dress: dengentropy@uestc.edu.cn, prof.deng@hotmail.com 


Preprint submitted to Elsevier December 20, 2021 


Keywords: Random permutation set, Shannon entropy, Deng entropy, 


Entropy of random permutation set, Uncertainty 


1. Introduction 


Uncertainty plays an important role in our daily life, different theo- 
ries have been developed to deal with uncertainty B4], 
such as probability theory [19], rough sets [B], fuzzy sets 30], 
type-2 fuzzy sets B], Evidence theory [51], Z-numbers [18], 
D number [10], belief rule [4], three-way decision [58], etc. These 
methods are applied in various areas, like traffic control [21], decision- 
making 27], classification [25], risk assessment [38], and so 
on [15720]. 

Most existing theories are based on set theory. Set theory provides a 
tool for describing the collection of objects or elements, which is important 
and fundamental in math science [17]. For instance, the sample space of 
an experiment in probability theory is the set that contains all possible 
outcomes of that experiment [19]. In evidence theory, the power set is the 
set that considers all possible subsets of frame of discernment, which is a 
basis for basic probability assignment (BPA) [9} 32]. 

Recently, for exploring the meaning of the power set in evidence theo- 
ry, a possible explanation of power set is proposed from the view of Pas- 
cal’s triangle and combinatorial number [36]. Then inspired by the idea 
of replacing combinatorial number with permutation number, Deng pro- 


posed a new type of set, called Random permutation set (RPS) [13]. RPS 
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consists of permutation event space (PES) and permutation mass function 
(PMF). The PES of a certain set considers all the permutation of that set. 
The elements of PES are called permutation events. PMF describes the 
chance of a certain permutation event that would happen. RPS is compat- 
ible with evidence theory and probability theory [13]. 

RPS provides a new perspective to deal with uncertainty regarding the 
order of elements, a straightforward question is that how to measure the 
uncertainty of RPS. Reviewing the existing uncertainty measures, various 
kinds of entropy functions have been presented, such as Shannon entropy 
in probability theory [33], Deng entropy in evidence theory [11], and fuzzy 
entropy in fuzzy sets [37]. In this paper, the entropy of RPS is presented 
for handling the uncertainty measure. The entropy of RPS is compatible 
with Deng entropy and Shannon entropy. When the order of elements in 
permutation events is ignored, the proposed RPS entropy will degenerate 
into Deng entropy. When each permutation event is limited to containing 
just one element, the proposed RPS entropy will degenerate into Shan- 
non entropy. Several numeric examples are illustrated the efficiency of the 
proposed RPS entropy. 

The rest of this article is as follows. Section 2 introduces the preliminar- 
ies. Section 3 presents the entropy of RPS. Section 4 uses some numerical 
example to illustrate the presented RPS entropy. Section 5 makes a brief 


conclusion. 


2. Preliminaries 


In this section, we briefly review some preliminaries of this paper. 


2.1. Random permutation set 
Random permutation set (RPS) is a novel set consisting of permutation 
event space (PES) and permutation mass function (PMF) [13]. Some basic 


definitions of RPS are given as follows. 


Definition 2.1 (Permutation event space). Given a fixed set of N mutually 
exclusive and exhaustive elements © = {61,02,...,0n}, its permutation event 
space (PES) is a set of all possible permutations of © defined as follows: 
PES (©) ={ Aj |i =0,...,N; j =1,..., P(N, i) } (1) 
=f Ø, (01) , (02) yoy (On) y (01, 02) , (02, 01) se (@n-1,9Nn) y 
(ON, On-1) pees (01, b2, e On) re (ON, On-1, e 01) } (2) 
in which P(N,i) is the i-permutation of N defined as P(N,i) = Nat The 
element Aj; in PES is called the permutation event, which is a tuple representing 
a possible permutation of ©, where i indicates the index for the cardinality of Aij 
and j denotes the index for the possible permutation. 


Definition 2.2 (Random permutation set). Given a fixed set of N mutually 
exclusive and exhaustive elements © = {01,0,...,0n }, its random permutation 
set (RPS) is a set of pairs defined as follows: 


RPS (©) = {(A,-@ (A)) | A € PES (©)} (3) 
where M is called the permutation mass function (PMF), which is defined as: 
M : PES(@) —> [0,1] (4) 


constrained by M (O) = O and Y acpgs(@) M (A) =1. 


Some important properties about RPS are discussed in [13]. Specifical- 
ly, the PES of RPS is compatible with the power set in evidence theory and 
sample space in probability theory. The PMF of RPS is compatible with 
BPA and probability distribution. 


2.2. Evidence theory 


Evidence theory (Dempster-Shafer evidence theory) provides an effi- 
cient tool for dealing with uncertainty [35]. Researchers have de- 
veloped evidence theory theoretically, especially for some open issues 
48]. For instance, the decision-making model based on mass function [5], 
uncertainty measure of mass function and the complex evidence the- 
ory [45]. With the superiority in uncertain environment, evidence 
theory also has been widely applied in engineering fields [16}[6]. 

Some basic conceptions about evidence theory are summarized as fol- 


lows [9} [32]. 


Definition 2.3 (Frame of discernment). Let , called the frame of discern- 
ment (FOD), denotes a fixed set of N mutually exclusive and exhaustive elements, 
indicated by 

QO = {w1 W2,...,Wn } (5) 


PS(Q) is the power set of Q, which contains all subsets of Q and has 2N 
elements, indicated by 


PS(O) = {Ay,A2,--+ , Aon} 
= 19, {wi}, (wah, {wn}, (6) 
{Ww}, Ww}, {w w3}, mee g {w1, wn}, SRRA O} 
Definition 2.4 (Mass function). Given a FOD of O, a basic probability assign- 


ment (BPA), also called a mass function, is a mapping from PS(Q) to [0, 1], 
formally defined by: 


m : PS(Q) — [0,1] (7) 
constrained by 
m(®)=Oand }, m(A)=1 (8) 
AE2o 


A is called a focal element if m(A) > 0. 


2.3. Shannon entropy 


Shannon entropy, which was proposed by Shannon, addressed the prob- 
lem of quantitative measurement of information [33]. The related defini- 
tion is described below: 


Definition 2.5. Given a probability distribution in a certain state space, Shan- 
non entropy is defined as 


Hse(p) = — ) pilogypi (9) 
i=1 


where n is the number of basic states, b is the base of logarithm. p; denotes the 
probability of state i appears, \°_, pi = 1. 


2.4. Deng entropy 


Entropy plays a significant role in uncertainty modelling 
56, [1], especially in complex systems [44] 2]. Deng entropy is a kind 
of belief entropy, which measures the uncertainty in evidence theory and 
applied in many fields [42) 23,41]. An important feature of Deng entropy 


is that it is compatible with Shannon entropy. 


Definition 2.6 (Deng entropy). Given a mass function distribution defined on 
O, Deng entropy is defined as [11]: 


m(A) 


Hpg(m) = D m(A) log zJA] =] 


AEPS(QO) 


(10) 


3. Entropy of random permutation set 


For measuring the uncertainty of RPS, the entropy of RPS is presented 


in this section. 


Definition 3.1 (Entropy of random permutation set). Given a RPS denoted 
as RPS (©) = { (Ai, M (Aij)) |Aij € PES (©) }, the entropy of RPS is de- 
fined as: 


N P(N,i) M Aj 
HRps (M) ae 3 m M (Aj) log (7) (11) 
1=1 j= 


where P(N, i) = ND is the i-permutation of N and F (i) = Vi_, P (i,k) = 


Da TO is the sum from 0-permutation of i to i-permutation of i. 


Proposition 3.1. If the order of elements in permutation event is ignored, the 
proposed RPS entropy will degenerate into Deng entropy in evidence theory. 


Proof 3.1. If the order of elements in permutation event is ignored, the permu- 
tation number P(N, i) degenerates into combinatorial number C(N, i), and F(i) 
should be calculated as F (i) = Y} o C(i,k) = 2'. 


Hrps (M) m 2 L M (Aij) log (Fat) 
j= 


3 M (Aij) log (5e = 2 (12) 


As discussed in Ref. [13], under the situation of ignoring the order of elements 
in permutation event, the PES of RPS degenerates to the power set, and the PMF 
of RPS degenerates to BPA in evidence theory. Hence Eq. is also calculated 
as 


mA; 
Arps (M) T y m(A;) log (A 2) 
A;EPS(Q) om 
=H D E(m) 
Therefore, when the order of elements in permutation event is ignored, the 
proposed RPS entropy degenerates to Deng entropy. 


(13) 
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Proposition 3.2. When each permutation event is limited to containing just one 
element, the proposed RPS entropy will degenerate into Shannon entropy in prob- 
ability theory. 


Proof 3.2. If each permutation event is limited to containing just one element, 
i = 1, Fi) = F(1) =2. 


Arps (M) A , M (Ay) log eo 


= D M (Ajj) log (42) (14) 


As discussed in Ref. [13], under the situation of containing just one element 
in each permutation event, the PES of RPS degenerates to the sample space, and 
the PMF of RPS degenerates to probability distribution. Hence Eq. is also 
calculated as 


N 
Hpps (M) = —} _ pjlog p; 
j=l 


= Hsg(p) 


Therefore, when each permutation event is limited to containing just one ele- 
ment, the proposed RPS entropy degenerates to Shannon entropy. 


(15) 


In conclusion, from Propositions 3.1 and 3.2, we can conclude that the 
proposed RPS entropy is compatible with Deng entropy and Shannon en- 


tropy, as shown in Fig. 


| Evidence 


theory 
Situation 1 Situation 1 Situation 1 
Uncertainty 
| RPS 
Situation 2 Situation 2 Situation 2 
Shannon | probability Probability 
= ( sample space EER | 
entropy | distribution theory 


Situation 1: ignore the order of the element in permutation event 


Situation 2: each permutation event just contains just one element 


Figure 1: The relationship between the proposed RPS entropy, Deng 


entropy and Shannon entropy 


4. Numerical examples and discussions 


In this section, some numerical examples are shown to illustrate the 


presented entropy of RPS. 


Example 4.1. Given the fixed set of © = {X, Y,Z},a RPS defined on © is given 
as follows: 


RPS;(O) = {< (X),0.4 >, < (Y, Z),0.1 >, < (X,Y, Z),0.15 = < (Y, Z, X),0.35 >} 


(16) 
Based on Eq. (11), the associated entropy of RPS, is calculated as 
Hres, (4) = — DEA (Ajj) log (A) 
= 04 seg (724) -o1stee (72) 
— 0.15 » log (aa) — 0.35 * log (ea) (7) 


= —0.4 «log (a) — 0.1 x log (=) 


0.15 0.35 
— 0.15 * log (5) — 0.35 * log (35) 
= 2.8975 


Followed by Example 4.1, consider the following two scenarios: 


e If the order of elements in permutation events is ignored, (X, Y, Z) 


and (Y, Z, X) are the same sets in Eq. (16), the RPS, is updated as 


RPS2(@) = {< (X),0.4 >,< (Y,Z),0.1 >,< (X,Y,Z),0.5 >} (18) 


10 


The associated RPS» entropy is calculated as 


0.4 0.1 0.5 
Arps, (@) = —0.4 x log (aa) — 0.1 * log (æa) — 0.5 * log (=a 4 


= —0.4 * lo a. — 0.1 x lo M — 0.5 * lo Vo 
8e \221 e (321 S\ 7-7 


= 1.8656 


(19) 

Actually, when the order of elements in permutation events is ig- 
nored, the permutation event space degenerates into the power set 
in evidence theory, i.e., PES(©) is the same as PS(Q). Therefore, the 
RPS? in Eq. can be regarded a mass function in evidence theory, 


just as 
m({X}) =0.4,m({Y,Z}) = 0.1,m({X, Y, Z}) = 0.5 (20) 


Based on Eq. (10), the associated Deng entropy is calculated as 


0.4 0.1 0.5 
Hpg (m) = —0.4 * log € = z) — 0.1 x log (z) — 0.5 x log (z) ei 


= 1.8656 


which is the same as Hrps, in Eq. (19). As a result, if the order of el- 
ements in PES is ignored, the proposed RPS entropy will degenerate 


into Deng entropy in evidence theory. 


For the RPS? in Eq. (16), let Ay = (X), Az = (Y, Z), A3 = (X,Y,Z). 
If these permutation events just contain one element, and they are 
mutually exclusive and independent, just as 

RPS3(@) = {< (A1),0.4 >,< (Az2),0.1 >,< (A3),05 >} (22) 
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) 


The associated entropy of RPS3 is calculated as 


Haps, (@) = 04+ log (aa) + 0.1 x log (aa) + 0.5 x log o d 


0.4 0.1 0.5 


= 1.3610 


(23) 
Actually, when each permutation event just contains one elemen- 
t and they are mutually exclusive and independent, the permuta- 
tion event space is equivalent to the sample space composed of basic 
events in probability theory. Therefore, the RPS3 in Eq. can be 


regarded a probability distribution, just as 


p(X) = 04, p(Y) = 0.1, p(Z) = 0.5 (24) 


Based on Eq. (9), the Shannon entropy is calculated as 


Hse(p) = —0.4 x log (0.4) — 0.1 * log (0.1) — 0.5 * log (0.5) 05) 
25 
= 1.3610 
which is the same as Hrps, in Eq. (23). As a result, if each per- 
mutation event just contains one element and they are mutually ex- 


clusive and independent, the proposed RPS entropy will degenerate 


into Shannon entropy. 


Based on the discussion of these two scenarios, it can be concluded that 
the proposed RPS entropy is compatible with Deng entropy and Shannon 
entropy, as shown in Fig. 
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The proposed 
RPS entropy 
| Degenerate 


[ Deng entropy j 
| Degenerate 


( Shannon entropy ) 


Figure 2: the proposed RPS entropy is compatible with Deng entropy and 


Shannon entropy 


Example 4.2. Given a fixed set of © = {1,2,3,...,10}. A RPS defined on © is 
shown as follows. 


RPS(®) = {< (3,4,5),0.4 >, < (6),0.1 >, < (X),0.8 >, < (1,2,3,...,10),0.1 >} 


If the order in permutation events is ignored, the RPS is a mass function in evi- 
dence theory. 


m({3,4,5}) = 0.4, m({6}) = 0.1,m({X}) = 0.8,m(©) = 0.1 


When X changes from 1 to 1,2,3,...,10, the values of Deng entropy 
and the RPS entropy are calculated, which are shown in Tableļ[i]and Fig- 
ure B] 

From Table |1} and Figure |3} the results shows that as the size of sub- 
set X rises, both Deng entropy and the proposed RPS entropy increase 
monotonously. It is reasonable that the entropy values increase when the 


uncertainty involving a set increases. Importantly, with respect to the 
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Table 1: Deng entropy and the proposed RPS entropy when X chenges 


X Dengentropy TheRPSentropy 

1 2.1622 3.5406 

1,2 3.4301 5.1406 

1,2,3 4.4080 6.6662 

1,2,3,4 5.2877 8.3406 
1,2,3,4,5 6.1255 10.2161 
1,2,3,4,5,6 6.9440 12.2876 
1,2,3,4,5,6,7 7.7531 14.5341 
1,2,3,4,5,6,7,8 8.5576 16.9342 
1,2,3,4,5,6,7,8,9 9.3599 19.4701 
1,2,3,4,5,6,7,8,9,10 10.1610 22.1277 


24 
21 
18 
15 
12 


Values of entropy 


O Ww D O 


1 2 3 4 5 6 7 8 9 10 
Size of X 
=@=Deng entropy =@=The entropy of RPS 


Figure 3: The trend of Deng entropy and the proposed RPS entropy when 
X changes 
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same size of X, the value of RPS entropy is larger than that of Deng en- 
tropy. This means that, the uncertainty of a RPS is larger than that of a 
mass function, since RPS takes permutation of a certain set into account 


while a mass function does not consider that. 


5. Conclusion 


Entropy is an important function to measure uncertainty. The main 
contribution of this paper is that the entropy of a new kind of set, named 
as Random permutation set (RPS), is first proposed. The proposed RPS 
entropy are compatible with Deng entropy and Shannon entropy. When 
the order of elements in permutation event is ignored, the proposed RP- 
S entropy degenerates into Deng entropy. When each permutation event 
is limited to containing just one element, the proposed RPS entropy de- 
generates into Shannon entropy. Numerical examples are illustrated the 
proposed entropy of RPS. The new entropy provides a promising way for 
measuring the uncertain degree and handling ranked uncertain informa- 


tion. 
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